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' Abstract. In this paper we present two searches for new physics in T(35) decays collected by the BaBAR 

f— ( ' detector. We search for charged lepton-flavour violating decays of the T{3S), which are unobservable in 

, the Standard Model but are predicted to occur in several beyond-the-Standard Model scenarios. We also 

• search for production of a light Higgs or Higgs-like state produced in radiative decays of the T{3S) and 

I decaying to muon pairs. 

V ■ 

Qh| 1. Introduction 

^ ■ When the Large Hadron CoUider becomes operational, it will probe physics beyond the Standard Model 

I— I. (SM) by searching for direct production of new particles such as those predicted by Supersymmetry and 

' models with extra dimensions. However, it is also possible to search for new physics in data collected 

^ ■ at lower collision energies by searching for rare and exotic processes which are forbidden in the SM. In 

I this paper two such searches are presented, which use data collected by the BaBar detector lUl situated 

^ ■ at the PEP-II collider at SLAC National Laboratory. PEP-II nominally collides electrons and positrons at 

Q . a center-of-mass (CM) collision energy ^/s = My(as) ' producing pairs of B mesons which are used to 

^ I study charge-parity violation. In the searches presented here the collision energy is tuned to the T{3S) 

Q ' mass, which is below the threshold for B meson pair production. The width of the T(35) is smaller 

0> . than that of the T{4S) by three orders of magnitude, and the branching fractions for rare T{3S) decays 

^ I are therefore larger by 0(10'^). This leads to dramatic enhancement in the sensitivity to rare and exotic 

■ processes, motivating the collection of 122 x 10^ T(3S) decays at the end of PEP-II operations. 

^ , 2. Search for Lepton-Flavour Violating T(35) Decays 
■ - - ' In the SM, the rates for charged lepton-flavour violating (CLFV) processes are suppressed by 

(A(m^)/M^)^ < 10""^^ ElO and are therefore unobservable. Here A(m^) is the difference between 
the squared masses of neutrinos of different flavour and Mw is the charged weak vector boson 
mass. Several beyond-the-Standard Model (BSM) scenarios, including Supersymmetry and models 
with leptoquarks or compositeness, predict observable rates for CLFV processes, which would therefore 
provide a clear signal of new physics. These processes are generally mediated by new particles appearing 
in loops, whose masses may therefore far exceed the 10.35 GeV CM collision energy. The previous 
constraints on CLFV T{3S) decays come from the CLEO experiment, which placed the 95% confidence 
level upper limit BF{T{3S) —>■ fi^T^)< 2.03 x 10"^ [4J. In this analysis, documented in Q, upper 
limits on BF{T(3S) e^T^) and BF{r{3S) H^t^) are placed at the 10"*' level. These results 
are used to probe new physics at the TeV mass scale. 

The signature of our signal T{3S) —>■ e^r^ and T{3S) fi^r^ decays consists of a primary high- 
momentum lepton, either an electron or muon, plus a tau decay in the opposite hemisphere. The tau is 
required to decay to a single charged particle plus possible additional neutral pions. If the tau decays 
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Figure 1. Fit results for the four signal channels, where 'leptonic' and 'hadronic' refer to the r decay 
mode. The thin green dashed line is the r-pair background PDF, the medium magenta dashed line is the 
Bhabha/^-pair background PDF, the thick red line is the signal PDF, and the solid blue line is the sum of 
these components. The inset shows a close-up of the region 0.95 < p^/Eb < 1.02. The extracted signal 
yield NgiG is displayed with its statistical and systematic uncertainties. 

leptonically, we require that the tau daughter and primary leptons are of different flavour, while if the 
tau decays hadronically we require one or two additional neutral pions from this decay. This leads to 
four signal channels, consisting of leptonic and hadronic tau decay modes for the T{3S) — > e^r^ and 
T(3S') — > fi^r"^ searches. The beam-energy-normalized primary lepton CM momentum x = pi/Eb is 
used to discriminate between the signal and background processes. The signal x distribution is peaked 
at X w 0.97 since the momentum of the primary lepton from the T{?>S) — > i^r^ decay is fixed by the 
two-body decay kinematics. The background is dominated by r-pair production, which constitutes an 
irreducible background. The r-pair x distribution is smooth and approaches zero as x ^ xmax, where 
xmax ^ 0.97 is the kinematic endpoint of the lepton momentum in the decay r^ —>■ £~i'£i'r, boosted 
into the T{3S) rest-frame. There is also a contribution to the T{3S) — > e^r^ search from Bhabha 
events and to the T{3S) — > /u^r^ search from /i-pair events. The x distributions of these reducible 
backgrounds have a peaking component near x = 1. 

All events are required to pass a set of preselection criteria which suppress Bhabha, ^-pair and two- 
photon processes, as well as beam-gas interactions. Events are then classified into one of the four signal 
channels based on the identified particle types and their CM momenta, and additional kinematic selection 
criteria are applied to further suppress the Bhabha and /^-pair backgrounds. After selection, an unbinned, 
extended maximum likelihood fit is performed using the x distributions for the four signal channels 
individually. Probability density functions (PDFs) for the signal, Bhabha//^-pair and r-pair processes 
are determined using simulated events and T(45) data, which is not expected to contain signal events. 
A global PDF consisting of the sum of these three components is fitted to the x distributions, and the 
yield of each component is extracted by the fit as shown in Fig. [T] The resulting signal yields are all 
consistent with zero within ±2.1(7 after including statistical and systematic uncertainties, where the 
systematic uncertainties are dominated by uncertainties in the PDF shapes. To extract the branching 
fraction upper limits, the likelihood as a function of the branching fractions is determined for the 
four signal channels individually. The likelihood functions for the two T(35) — > e^r^ channels 
are multiplied to give the combined T{3S) — > e^r^ likelihood function, and likewise for the two 
T{3S) iji^T^ channels. The 90% confidence level uppers limits are determined by integrating the 



likelihood functions L and finding UL such that /p^^ L d{BF)l /p°° L d{BF) = 0.9. The extracted upper 
limits are SF(r(35) e^T^)< 5.0 x 10~^ which represents the first upper limit on this process, 
and BF{T{3S) fi^T^)< 4.1 x 10^^, which represents a sensitivity improvement of more than a 
factor of four with respect to the previous upper limit from the CLEO experiment. These upper limits 
can be used to constrain new physics using effective field theory. Parameterizing the T{3S) — > £^t^ 
process {£ = e, /i) as a generic bbir contact interaction with coupling constant air and mass scale 
Ai-r, the branching fraction BF{T{3S) i^r^) is proportional to the quantity aj^/Aj^, assuming 
vector coupling of the bMr interaction term I^.T). The upper hmits on BF{T{3S) I^t^) therefore 
translate to upper limits on aj^/Aj^, which can be used to exclude a region of the Air vs. atr plane. 
In the strong coupling limit (ogr = a^r = 1)> these results translate to the 90% confidence level lower 
limits Aer > 1.4 TeV and A^r > 1-5 TeV on the mass scale of new physics contributing to CLFV T{3S) 
decays. 

3. Search for a Low-Mass Scalar in Radiative Y{3S) Decays 

We search for a low-mass scalar particle in decays of the T{3S) as documented in fSl. This search 
is motivated by theoretical models including the Next-to-Minimal Supersymmetric Model (NMSSM), 
which introduces a Higgs singlet state in additional to the two Higgs doublets of the MSSM ll9l [TOl. 
and a recent model which introduces a light axion ifTTl . These particles may be produced in the 
radiative decay T{3S) 7^", and the branching fraction for this decay is predicted to be in the 
range 10^^ — 10~^ for the given models. The branching fraction for the decay A^ /^^^ is 
predicted to be large if M^o < 2mr, leading to a clean final state signature consisting of a muon 
pair and a photon. This search is complementary to the Higgs searches performed at the LEP2 and 
Tevatron experiments. The searches performed at LEP2 are not sensitive to a Higgs state whose 
mass is below 2m,fc, since these experiments searched for the Higgs decaying to two b jets. The most 
stringent constraints on the signal process come from the CLEO experiment, which placed the upper Umit 
BFeff = BF{T{1S) 7^0) x BF{A° < (1 - 20) x lO'^ for M^o < 3.6 GeV/c^ HI 

on the effective signal branching fraction. Further motivation for this search comes from evidence of 
a resonance structure in the dimuon invariant mass distribution of the decay E — > pfj,^fi^ observed 
by the HyperCP experiment lfT3l . Three events were observed at = 214 MeV/c^, which may 
be interpreted as a light scalar decaying to a muon pair. Furthermore, in this analysis we investigate the 
nature of the bb ground state rjb recently discovered at BaBar [14J by searching for the decay ryf, fJ-^l^ - 
The branching for this decay is not predicted to be sizable if the r]h is a qq meson state. 

The signature of our events consists of two oppositely-charged tracks, back-to-back with a photon 
in the CM frame. The photon energy is required to satisfy i?^ > 0.5 GeV and the total recorded 
energy must be consistent with ^/s. The main background is due to e^e~ fi'^fi^j production, 
which leads to a smooth dimuon invariant mass distribution as shown in Fig. [2^. The processes 
e"*"e~ — > jisrP^, vr+vr^, in which one of the charged pions is misidentified as a muon, and 

e+e" — > 'yisnX, X —>■ p^p^, where X = J/ip, ip{2S), T{1S), contribute additional peaking 
backgrounds. The strategy used in this analysis is to perform a series of maximum likelihood fits 

to the distribution of reduced mass defined by rriR = y^M^^ — 4m^. This variable is used instead 
of the dimuon mass because its distribution is smoother at low mass. Using a sliding window of 
width ~ 300 MeV/c^, ~ 2000 fits are performed in the range of reduced mass corresponding to 
0.212 GeV/c^ < M^o < 9.3 GeV/c^. For each fit, the signal is modeled by a peaking function 
consisting of the sum of two Crystal Ball functions ITSl with low- and high-energy tails. The radiative 
dimuon background is modeled by a threshold function of the form tanh(poly(m/j)) in the range 
rriR < 230 MeV/c^ and by a first- or second-order polynomial for mR > 230 MeV/c^. For the 
~ 2000 fits, the signal significance S is determined according to = sign ( Nsig) V 2 log ( L a/ax /-^o ) . 
where Nsig is the extracted signal yield, Lmax is the value of the maximized likelihood function, and 
Lq is the value of the likelihood function when the signal yield is fixed to zero. The distribution of S 
for the ~ 2000 fits is found to be well-described by a Gaussian with a mean consistent with zero and 
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Figure 2. (a) Dimuon invariant mass distribution for events passing selection and (b) 90% confidence 
level upper limits on the effective branching fraction BFeff = BF(T{3S) jA°) x BF{A° 
H^fJ^^) as a function of the A'^ mass. 

width consistent with one, with no outliers at high significance values. We therefore conclude that no 
statistically significant signal is observed, and the results are used to place the 90% confidence level 
upper limits BFeff = BF{T{3S) 7^°) x BF{A^ fJ-^fJ-') < (0.25 - 5.2) x 10"^ as shown in 
Fig.|2j5. These results represent the best upper limits to date on the process T{3S) — > 7^*^, A'^ —>■ /i"*"//". 

We investigate the HyperCP anomaly by examining the extracted signal yield at the reduced mass 
corresponding to M^^ = 214 MeV/c^. The extracted effective branching fraction is BFeff = 
(1.2 lb 4.3 lb 1.7) X 10"'', where the first error is statistical and the second is systematic, which is 
consistent with zero and corresponds to the 90% confidence level upper limit BFeff < 8 x 10^''. We 
also search for dimuon decays of the 7^5 using the extracted signal yield at M^^ = Mr^^ =9.38 GeV/c^. 
We find BF{T{3S) 77/5) x BF{r]b ^+/i") = (0.2 ib 3.0 ib 0.9) x 10"'^, which is consistent with 
zero. Using the resuh from the BaBar experiment BF{T{3S) -yqi,) = (4.8 ib 0.5 ib 1.2) x 10""^ U4J, 
we determine BF{r]b ^+/i") = (0.0 ib 0.6 ib 0.2) % < 0.8 % at 90% confidence level. 

4. Conclusions and Outlook 

Decays of the narrow T resonances provide an excellent laboratory for searches for rare and exotic 
processes. We have performed a search for lepton-flavour violation in T(35) decays and placed the best 
upper limits to date, BF{T{3S) e=^r'F)< 5.0 x lO"*' and BF{T{3S) /U=^r=F)< 4.1 x lO"*'. 
These results are used to probe TeV-scale physics using effective field theory. We have also performed 
a search for a light scalar in radiative decays of the T{3S), and placed the best upper limit to date 
BFeff = BF{r{3S) 7^°) x BF{A^ fJ-^fJ-') < (0.25 - 5.2) x 10"^. We find no evidence to 
substantiate the evidence for a light scalar decaying to muon pairs observed by the HyperCP experiment. 
We place the upper limit BF{r]h — > /x+/i^) < 0.8 % on the dimuon branching fraction of the 7]i,. All 
upper limits are at 90% confidence level. These results will be improved by extending the search to 
99 X 10^ T(25) decays collected with the BaBar detector. 
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